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LT. DECISION-MAKING-AND ARTIFICIAL INTELLIGENCE 


Pee PROBLEM REPRESENTATION 

aiiere a5 a fairly general and important class of problems 
Teereiimcan De represented in the form of a tree structure [1]. 
Mimoeeclass of problems includes applications such as problems 
MmieehessS, Beometry and indefinite integration. The tree 
mervuevure Of this class of problems is formed as follows: 
The problem is represented in a state space such that the 
Peobee soatve 15 the problem state and the solution is the 
Permmescawe., in order to reach the goal state it may be 
aeecacary Lo pass through one or more sub-goal states. If 
Miemoraves are represented as nodes, and all possible move- 
ments from one node to another are represented by branches, 
Pierre provlem description is a tree structure as shown in 
mueuree 1. The nodes at level Lt+tl generated from a node at 
level L are Known as first successor nodes. Thus in Figure 
megecdes es, 12 and 13 are first successors to node Oa 

Generation of all possible successor nodes from any 
given node in a tree is known as complete node expansion. 
One approach to general problem solving is to expand the 
mireblem node into a set of first successor nodes, then ex- 
pand each of the successor Meteo oneCmaO Om UMNt Il sea heim the 
Pe imestares— node — is reached or all possibilities are ex- 
hausted. Implicit in this technique is a test conducted at 
Gach node to determine whether the goal state has in fact 


been reached. 
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if is not difficult to see that a general tree structure 
expands exponentially. That is, if Sin HOdes ia ote ecea Gor 
nodes, then the number of nodes at each level L - with L=0 
for the initial node - can be expressed as nb 

Per proolems With nm or lL — or both -—- large, exhaustive 
Searcy Of the tree as proposed above becomes impossible, even 
iepne Search iS carried out by a high-speed computer. The 
meoolem 1s said to suffer from-combinatorial explosion. 

EPEeolemls With very large search trees form a set of very 
Green lt and interesting problems, particularly from the 
Beaemwornis Of Drosramming their solution on a computer. Many 
Gimenese large problems represent areas where human beings 
eiymecope very well. Examples include theorem-proving, sen- 
Pwo waists, the recognition of cursive script. chess and 
famedese translation. Research on the solution of this kind 


Sreproolem by computer has come to be known as the Sie lid y=e@ is 


hiecattei1al Intelligence. 


Pee ene CTAL INTELLIGENCE 

Twoaneeanpole Of an Artificial Intelligence problem, con-— 
pai@eretiie Game of chess. Chess can be represented by a tree 
Pobre ach OOard DOsition a node and each possible move a 
Pigsecn, As in all two-person competitive game trees, since 
each person makes a decision only at every alternate level, 
the term ply has come into use as a descriptor of a player's 
Geercvomemleyels. Each level therefore GeDiGeS CNUs ply, and 
each player will make a decision at ply n from his starting 


MemdeemWwidere N—-1,2,3,..- 
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Bocmemodemin Chess typically generates around 30 succes- 
sors L2]. The complete game tree menesc teeter alleprac— 
meeal Purposes, infinite. Yet men play chess, and some men 
play it very well. 

io uowoel si that even chess @rand masters search 
fewer than 100 nodes before arriving at a decision for a 
meve. Modern chess programs search many thousands of nodes, 
eiemyer their most successful -level of play is only at the 
high amateur level [4]. 

ine mecruUclal aspect is that the grand master searches 
only a small portion - indeed a fraction too small to be 
measured —- of the tree, but he somehow selects the most pro- 
meer ve branches On which to carry out his limited search. 
ime process of eliminating branches from consideration for 
further search is known as pruning, and the process whereby 
Sige sOranch is Selected for action is known as decision-making. 

The main purposes of the study of Artificial Intelligence 
Saamrounderseand human intelligence, to find rules of de- 
€momon-mMaking which can be used by a computer, Se ie) lise 
machine intelligence to solve difficult problems [5]. 

1. Human Decision-Making 

Mewemolained above, the process whereby one branch 
Peoimanmode is selected from others for action is known as 
decision-making. Human beings make decisions in complex 
Wayo Woich are dittle understood. 

Onemoreneh of Artiricial Intelligence is interested 
imecdevermmning how the human brain makes decisions. Ke- 


searchers who study man's decision-making processes make use 
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Sue cCechnique known emo vecolcur In Using the protocol 
method the researcher observes the eoect thinking aloud 
while trying to solve a problem. In chess, this method 
has extended to study of the eye movements of grand masters 
moore COntemplating play. From the study of protocols, re- 
Searchers construct a computer program model of the problem- 
solving techniques displayed, and note how the results of 
meeir program differ from that of the human subject. 

2. Machine Decision-Making 

The other branch of Artificial Intelligence is in- 
terested only in obtaining intelligent behavior from a com- 
Meee A researcher from this school is not concerned 
Wimecier Che structure of his program in any way resembles 
the human decision-making process. He is concerned with 
Mmesults. 

Ome method used by researchers of this school is 
miapeor Neuristic programming. A heuristic [6] is a rule of 
Pimms coravesy or trick which is used to ehance the decision- 
making process of a computer program. Related MO oN word 
"eureka," - from the Greek heuriskein, serving to discover - 
Se@etrictic is a technique used by the computer programmer, 
not by the computer. 

Paimordereve atvack Artificial Intelligence problems 
by computer, the problem must first be structured in such a 
way that the computer can deal with it. Since computers can 
only perform a strictly defined and iimted ser tol eperabions , 
imeem jompack Of the computer program to present the problem 


fomomeeries Om Operavions which the machine can carry out. 


M2 





The programmer uses heuristics when he translates a compiex 
Peoelem into a series of machine operations. 

Mic amp lemol vaeneuristic used in chess is a 
Pememed LTO determine control of the eerteeie OF Cie meeard. 7 ef 
meetrammer could use the heuristic that occupation of a ma- 
iemruy Of the center four squares on the board by, say, 
White represents control of the center by White. Based on 
this heuristic, the programmer would instruct the machine 
to determine which player - if any - has more pieces on the 
eemeet [OUr squares. If the heuristic is a good one, then 
the answer computed by the machine will be equivalent to 
Mremoetermination of center control by a grand master. 

MenoOoweproorems OF Arvtifieral Intelligence, the 
Paecsrammer Will use many such heuristics in an attempt To 
emeole the computer to evaluate a node and to decide which 
Peemen Irom that node is most likely to lead towards the 
Eeemseeve. The Combination of a number of heuristically 
programmed operations used to evaluate a node is known as 
pee valuation function. | 

The na Bie idea 61 aeuristic programming 15 to use 
iniormation derived from the problem to guide the search 
through the problem nodes in such a@ way as to limit the 
number of nodes searched while still successfully finding 
the goal state (node). 

Heuristic search may be either breadth-first or 
Tre oueee tt all first successors of each node are 
searched before more nodes are generated, then the resulting 


search is called a breadth-first search, as shown in Figure 


= 





2. Ji the search proceeds from one of the first successors 
CO po llowine levels before visiting other nodes at the early 
Hevels, 1 1s termed a4 depth-first search, as shown in 
Pigure 3. Roughly speaking, a breadth-first procedure 
generates from the top, while a depth-first procedure gen- 
eeeves from the left. 

There are two general methods of tree pruning widely 
Msecd in heuristic programming. The first involves depth- 
first search wherein the last node generated — for example 
node 7 at level 3 in Figure 3 - is assigned a value based 
on the computer's evaluation function. Based on this value, 
the predecessor node at level 2 (node 2) is assigned a value, 
meemconOn Until the initial node is reached. This process 
is called "backing-up" the value of one node to its prede- 
Permsors, and if, based on the value backed-up to the initial 
node, this whole branch (nodes 1 to 7) is eliminated from 
Mierier consideravion then it is said that the tree has been 
pruned by backward pruning. 

The second method of tree pruning is to use informa- 
miemieavartable ac a node to eliminate from consideration 
some branches emanating from that node. This technique is 
known as forward vruning. 

A widely used method of backward pruning in game 
trees is known as the alpha-beta procedure. The procedure 
functions as follows: Consider the diagram of Figure J, 
which represents a game tree wherein the square nodes are 


BieweOstbton ay Which it js Player Ats turn to move, and 
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the round nodes are the Peoterons ab whieh it is Player B's 
Geaurn to move. Player A is the computer. 

At the initial node, Player A has two options 
(oranches) leading to nodes Pl and P2. The computer has 
Seweained 2a (possibly backed-up) value for node Pl of V1=3. 
The alpha-beta procedure sets alpha=3 at P2. Now when node 
P21 is generated and evaluated, and the value V21 is found 
wo be less than alpha, the procedure is said to have found 
pemalpha Ccuvoif. That is, the computer does not bother to 
mimemave modes F22, P23,... and their successors, because 
it is already evident that node P2 is worse for Player A than 
meae PL, since it is now known that Player B at node P2 has 
av least cone choice which will result in a node of value less 
mice nan resulting from any possible branching from node Pl. 
Therefore Player A should choose the branch to Pl as his 
Mext move. 

Selah i ierietire >. the computer has assigned 2 
(possibly backed-up) value of V11l=4 for node Pll. This 
Value becomes the beta value for the nodes Plel, Plee, etc. 
Thus when the computer finds node P121 with a value of V21=8 
meaeawor than beta, it finds a beta cutoff. That is, it does 
iivmes-merave and evaluate node Pi3l. Here again, it is as- 
sumed that Player B acting at node Pl will not choose the 
Mieaiem to node Pile, because there is at least one successor 
to Pl2 which is greater in value ‘even any of the successors 
oo Pil. 

Note that this procedure depends on the accuracy and 


Validity of the evaluations at each node. That is, if the 
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heuristics used to generate the values are incorrect or in- 
complete, then the numbers assigned to each node become at 


best. less meaningful, and the procedure may fail. 
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Meo er VyE LOGIC 


As described above, the success of the alpha-beta pro- 
cedure - and indeed of any tree-search procedure - depends 
meen che validity of the evaluation function used to assign 
meee sbO a mode. Thus one of the most difficult tasks 
facing the Artificial Intelligence programmer is the selec- 
tion and generation of an evaluation function. 

One method used to generate evaluation functions is to 
select a set of heuristics applicable to the problem, pro- 
gram the resulting operations and generate from the results 
of computation a set of parameters which describe the problem 
foe. tthe values of the parameters - if thev are correct 
and complete - can then be combined to form an evaluation of 
omeemode in the tree. 

The set of the values of heuristically reenerated param- 
Slers Can, of course, be combined in many ways. One method 
could be simply summing the values to obtain a cee value 
for the node. Another method, more commonly used, is to form 
a weighted sum of the parameter values wherein the weights 
can be adjusted to obtain better results. A computer model 


of this technique is known as an adaptive logic element. 


A. ADAPTIVE LOGIC ELEMENTS 
meapetve logic elements have been studied and analyzed 
for a number of years. These elements have found particular 


Pieamidcss im the field of trainable pattern classifying 


eat 





systems [7]. Training algorithms for these elements exist 
and are well-defined. 

Bareure 6 1s a Ales ai of an adaptive linear threshold 
logic element, or Adaline [8]. The fee sLeFOUNE Sate) lave! | Wels) Iaiiare 
form a vector —P Pacwmetememus ol which is multiplied by the 


corresponding element of a weight vector Wee Die Rouleau or 


the summer is then a scalar Vs with the value yak," We. 


ieee tLhat the first input Xo 5 1s always +1; because of 
this the zeroth weight element Les controls the threshold 
Of the Adaline. Thus the output y 5 is biased by the value 


ok The output sum Y is now fed to the quantizer which pro- 


euces the quantized output of the Adaline, lee 


The adaptation machinery receives as inputs a V5. 


and the desired response of the element rt 1 a= a: then 


the Adaline has performed properly and no action is taken 


4 


(actually in some applications the element may be rewarded 
for correct response). If q,7d, , there exists an error e 
foe n 15 equal to ae Ci 4 -X Wy. ia response vo Chis 
error @¢ the adaptation machinery causes the Penee ne to 
be changed. I1f this process is now repeated with the same 
input the Adaline will eventually arrive at the proper set 


of weights such that the desired output is obtained for 


Eme input = 


Eee CeEARNING WITH A TEACHER 

Piianiveonsume fields for which adaptive logic elements 
have been used, for example pattern recognition, the desired 
Output oe TrorecachimpuL Vector me is well known. In these 
fields, it is usually assumed that the set of patterns of 


Ae 
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interest is small compared to the total number of possible 
patterns, and that the set of patterns corresponds to a 
imenearly separable function such that there is a set of 
femetes waich will provide the desired output for all input 
patterns of interest [9]. In cases where these assumptions 
are met, Adalines can provide high accuracy pattern recogni- 
Imeoneat very low cost for computer storage or processing 
time. 

When an Adaline is used as described above, the adapta- 
tion machinery operates on the same input iteratively aed 
the desired output is obtained, and after the element is 
Prained for a large number of input patterns, the adaptation 
machinery is removed and the element will now be able to 
feeornize most of the class of patterns for which it nas 
been trained. This method of training is known as learning 
Pees ceacmer, Adalines which learn with a teacher exhibit 
well-defined, exponential learning curves and weil. always be 
stable under known conditions [10]. 


mie weilehnt iteration rule 


W = W. + 


a a .X 
aed 1 aed ie | 


J 
developed by Widrow:-and Hoff [16] ensures that }e, | will be 


reduced by the pee adapuarcton, So long as 


aera ee. 


See seanRNING WITH A CRITIC 
Adalines trained by learning with a teacher have proven 


tO be a valuable tool in many fields. However, they cannot 
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be used when the desired output for each input pattern is 
unknown. To overcome this difficulty, and to expand the 
meld Of applications for Adalines, Widrow, Gupta and Maitra 
have proposed a new technique for training an Adaline, called 
Mearning with a critie [11]. 

PMotiiomielMod, also called selective-bootstrap learning, 
the output ae of the Adaline is used to form the desired re- 
sponse signal d. (see Figure 7). The bootstrap control sig- 
nal Ds determines whether fo Sel: or Sela dwieVe, olong Bieler! 
signal dD; is determined by an external evaluator, or critic. 
imemphe Critic feels that the present decision (output q,) is 
amember of a set of relatively successful decisions, then 
Peis set such that oes In other words, the logic ele- 
mene 16 being told that the decision just made is a correct 
Perel, On the other hand, the critic feels that the de- 
eeeror was not a good one, then ae is set such that ect 

In the first case, called positive. bootstrap adaptation 
em@elearning by reward, the Adaline iMG ve smainvain tie 
responses that already exist. In the second age. called 
negative bootstrap adaptation or learning by punishment, the 
Adaline will tend to change its existing output. 

Continued iterative application of Ds as determined by 
Wiemetrigie results in the training of the Adaline. Note 


that while learning with a teacher is well-defined and spe- 


Pere lcariine with a Gritic 1s gualitative in nature. 


fas: 


Oo 
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tee wool Ob CHESS 


ice vureMpuNbOrprOe@e@am a computer to play grandmaster 
iwel chess is a probilem which has fascinated the experts 
eumost irom the inception of the computer itself. Its solu- 
MmieG@mmasa vO Gave eluded the Dest efforts of the artificial 
maeeliliigence community and the utilization of the most po- 


werful computing machinery available. 


Pee DESCRIPTION OF THE PROBLEM 
1. Why Chess? 

Chess is merely a game. It is, to be sure, a very 
difficult game, and one which requires a great deal of skill 
meametrder CO play well. But the qualities of chess which make 
ifeocm al antveresting problem for computer programming are 
Meeecct Old: firstly, it is well-defined in that an exact 
model of the game can be programmed inte the computer. 
Beconaly, it is a very large problem; so large that no ex- 
Meustive search of all its possibilities could ever be car- 
fmmecd Out. Lastly, itv is a member of a class of large problems 
which human beings can solve very well even though their re- 
sourees seem tO Ro Gree more limited than those of the com- 
Sewer. iit Js sespecially this third quality which makes 
Chess such an interesting problem. It is generally felt that 
mie eadaility to program a computer to play Champlvons itp seve ll 
emess Will open new doors in all areas oi artificial 


intelligence [12]. Indeed, it has been said that "If one 
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could devise a successful Chess machine, one would seem to 
have penetrated VOomomtemcere or human intellectual endeavor 
mes). 

2. Orders of Magnitude 

Team wecmmamcm@esshbOard, 1C 15 difficult to imagine 
Just how complex the game really is. There are only sixty- 
meme squares on the board, and thirty-two pieces. Yet there 
mmeelO > board positions possible and more than 10'?° possi- 
ble games. To put these numbers in perspective, consider 
m@etethere are 10°" molecules comprising the entire earth 
[14]. Or consider a computer which could analyze one million 
Meera POSiItiOns in one second; then it would take this com- 
omer 4.17 x 107? years to analyze all board positions. 
Pemeesone miliion years of constant computation, the computer 
would have completed less than one thousand - billion - 
Peamerronchns of one percent of the total problem. 

The magnitude of these numbers is really beyond the 
comprehension of men. Yet contrasted with these astronomi- 
cal numbers are some small numbers associated with the human 
MeetMeWoich are especially interesting. The brain, while 
naving an enormous storage capacity, is inherently limited 
in many respects. Pics pmOmnelw ity 15 very SlOW, Operating 
in the range of hundredths of seconds [15]. Secondly, it 
Maem very small short-cterm memory. In fact, it has been 
shown [16] that short-term memory can only store about seven 
Peeaics Noteintermavion. ("Chunk," as distinct from "bit," 


has been chosen by G. A. Miller [16] to describe units of 
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information in ane brain. A chunk is variable in size and 
can ee from a Single number to, in the case of a chess 
expert, a complete chessboard position.) 

The question that arises from comparison of numbers 
such as 10** with numbers such as 7 is this: How can a 
mecmungly limived organism cope with such a vast problem? 
me answer to this question would probably solve the problem 
of computer chess - as well as many other problems - once 
mie LOr all. 

The key factor in the human's ability to play chess 
woes selection. As has been shown, a chess position pre- 
memes tne player with a@ choice of about thirty possible 
moves on the average. if he considers the opponent's pos- 
sible responses to each move, there are now about 900 pos- 
~eorlicies CO be explored. Since it is known that a 
grandmaster often looks 5 or 6 moves ahead [17], if he con- 
Sraered every possibility he would consider on the order of 
5 x 10'* moves! Yet it is known that the same grandmaster 
who looks 6 moves ahead only considers 50 - 100 possibilities 
at most [18]. Through some process not yet known, the 
Seated human player is able to drastically reduce the 
Peoecums pace On wWhach he operates to a level which he can 
handle. 

If all the computer had to do was search these 100 
nodes, and if the evaluation function used were reasonably 
time-efficient, then the competition between man and machine 
Poumcdmee no Contest. But the real problem for the computer 


is determining which hundred nodes to search. 
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The computer can partly make up for its lack of se- 
maenviloy Dy brute forces that is, it can search many thou- 
Ziieosoeon modes while the human is considering his hundred. 
But this advantage is not enough to offset ae human's ad- 
vantage of selectivity. 

Chess programming has therefore emphasized two major 
objectives: Increasing speed and power still more and in- 


ereasing the computer's selectivity. 


Pee alolORY OF COMPUTER CHESS 

The wie REO publication on chess machinery was 
Shannon's paper in 1950 [19]. In his paper he described 
the basic approach to creating a chess program five years 
before the availability of computers capable of average play. 
In 1957 Newell, Shaw and Simon [20] predicted, conservatively, 
that a computer would be world champion within 10 years. 

The complexity of the game was greatly underestimated. 

In 1967 Greenblatt [21] produced what is generally con- 
Saagered to be the most successful chess program. It plays 
at about the high amateur level. 

Other notable chess programs which have been written 
meelude Northwestern Univeristy's Chess 3.0, 3.5 and 4.0 
Pezcarowleki and Cooper's COKO Ti and III, Gillogly's Tech 


and Simon and Chase's MATER Program [22]. 


C. PROGRAMMING METHODS 
Most chess programs, including Greenblatt's, Chess 4.0 
Mgmoamtel's highly successful checker player, use the well- 


known alpha-beta tree search procedure as their basis. They 
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also incorporate a plausibility generator as a forward 
pruning technique; that is, the first successor nodes to 
the problem situation node are ordered according to an 
emaluavion function such that the most eieie bie or promis- 
ing branches from the problem node are searched first. 

A notable exception to the set of programs using alpha- 
beta is Tech [23] which, after an initial move ordering at 
Miee problem node, produces the search tree in a straight- 
forward fashion by brute force as deep as time will allow. 
mers Interesting to note that while the rating of Tech is 
only about 1300 - that of a weak amateur - in the second 
U. S. Computer Chess Championship Tech placed second, ahead 
Peeouler programs which use sophisticated evaluation functions. 

hozerowicki and Cooper's COKO IIT [24] uses a selective 
tree searching arooadusas whereby the entire tree is stored 
in memory and the machine makes a probabilistic estimate of 
bae most effective node on the tree for further search. 

Simon and Chase's MATER Program is an attempt to cause 
the computer to act exactly as a human chess player. From 
studies of protocols and human decision-making, they have 
constructed a program which contains all the verifiable 
elements of the human decision-making process. In imitating 
Tee om owl Ol the Structure of the brain, these researchers 
meee so be able to duplicate its function [25]. Although this 
approach has been likened to trying to debug a program with- 
out a computer [26], this study should bring greater know- 
ledge concerning not only chess but the nature of all human 


problem-solving. 
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Botvinnik [27] believes that it is important to know 
Pomel pleces are able to reach a certain square or sector 
of the board in a certain number of half-moves (plies). 
This establishes for each piece what Bot vinnik calls a 
"horizon." Planning would include only those pieces whose 
memerZzon 1S SuUificient to aid in attaining the goal. Some 
of Botvinnik's ideas have been programmed, but as yet no 
complete program incorporating all of his ideas has been 


prounced. 
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ieee GAteR AND’ PRO 


PLAYER and PRO are two programs written for the purpose 
of attacking the chess problem. PRO is in essence the adap- 
Cation machinery of an adaptive logic element which is used 
meu ne CLraining of PLAYER using published positions with 
Known best moves. Actual games are played by PLAYER alone; 


no learning takes place during a game. 


A. APPROACH TO THE PROBLEM 

As nas been shown, present day computer chess programs 
utilize the speed and power of modern computers to search 
‘thousands of nodes in order to arrive at a decision. This 
momieb tO Say that their programmers did not use very sophis- 
Dreated techniques in their designs in order to limit the 
search; however, the search carried out is still orders of 
magnitude greater than that carried out by a man. The ex- 
eee as one MATER Program of Simon and Chase, which as 
ieaeecrnoecd albLrempts CTO imitate human techniques. 

imiemapprooct of PLAYER is different from either of these. 
Pern aees nov try to imitate a human, nor does it use 
Pewee toree to search through a great many nodes. PLAYER 
was designed to study the chess problem and, insofar as 
Pesctoles LO provide an ordering of possible moves based on 
the initial node and its first successors only. A primary 
goal was to gather as much information as possible from the 


imimoteel state. 
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Mitteineeeeenpoon tO Cake advantage of two facts: The 
first is that a computer has perfect memory; that is, as- 
Smo 1G 1S functioning properly, it will not "miss" an 
opening or "not see" a threatening piece. The computer can 
easily keep track of a large number of pieces, positions 
and parameters as long as they are expressed in terms it 
San deal with. The second fact is a simple logical truth: 
All chess positions, assuming perfect play, terminate in 
either a win, a loss or a draw [28]. Therefore any chess 
ree roneto imp lieitiy either a winning position, a losing 
Mestv10n Or a draw position. if it could be assumed that a 
game is being played by two perfect chess players, a winning 
ooltyion Could only result in a win, a losing position only 


Mm~ercmmaiec a Gray ~Co ition cnly a draw. For example, since 


1 


White always has the advantage of the opening move [29], 
White should always win and Black should always lose. That 
this does not happen, even at the grandmaster level, is a 
testament to the fact that there are no perfect players. 
Miieerubpeda, Of Course, that just as there are no perfect 
Mayers, there is no one who can say for sure, for more than 
a very few given board situations, whether that situation is 
ene OSing or draw position. it can be postulated 
that there is a set of parameters which can describe any 
board position in these terms; so far no one has found it. 
iim pprotcimGr sh bAYHR 1s tO study the problem of param- 
Swemesenerarion and evaluation by surveying the current board 
situation in terms of winning, losing or drawing, and to find 


Paeveeyvaten will result in another situation no worse than 
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mae present Situation. In order to do this PLAYER must 
evaluate all possible moves, but only to a depth of 3+ ply. 
meeiem theretore tries to gather as much information pos- 
sible from a study of the original problem node and its 


first successors. 


mee) PLAYER 

PLAYER is a agua uber program written entirely in FORTRAN. 
PLAYER consists of a short MAIN program and five subroutines 
tien will be described below. 

1. Data Structure 

The chessboard is represented as an eight-by-eight 

array as shown in Figure 8. In all double-subscripted ar- 
rays, I represents the rank and J the file of the Oca a onM 
eeeciited. The following arrays form the basic data struc- 
moe Of PLAYER: 

0CCSQ(8,8) contains, in the location where a piece rests, 
the value of that piece. White pieces are coded as 
plus and Black pieces as minus. 

MEG(i6) and OPC(16) contain the locations, in the form 
lito! the mmachine and Opponent pleces respec— 
tVVciVvVehacm PpLece Mas a Speciiic number assigned 
to it: the pawns 1 - 8, the knights 9 and 10, the 
bishops 11 and 12, the rooks 13 and 14, the queen 
iipmamnd cae king 16. 

MVALPC(16) and OVALPC(16) contain the values of each piece 
according to the standard P=10, N=30, B=32, R=50, 


Q=90 and K=9900. If a pawn is promoted, its value 
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CHESSBOARD REPRESENTATION 









Figure 8. 
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Pomemameeanacecordingly, usually to that of a queen. 
PLAYER can accept any Rumer Se pawn promotions to 
any piece value although for its own pawn promotions 
it always chooses to promote to a queen. (Lack of 
Pitcmnactiuty cost COKO IIt a game [30]) If a piece 
is captured its value (and corresponding location in 
OCCSQ and MPC or OPC) is set to zero. 

MPOSMV(N) and OPOSMV(N) contain the possible moves of the 
machine and opponent respectively. Moves are en- 
coded as 100 times the piece number plus the square 
to which it can move. For example, a possible move 
of 242 means that piece number 2 can move to square 
42 (or 4,2). Castle moves are specially coded as 
Womuommecaoatle lent or 99 for castle right. 

MPHMV(N) and OPHMV(N) contain re moves for machine and 
SPUeneieerespeceyivyely-. Aephantom move is not 4 
legal move, but represents a conceivable move under 
Corppatinecrreumsvances., “Nor instance, assume that 
the computer's piece number 9 has a possible move 
to square 57, which is unoccupied. Now if square 
57 subsequently becomes occupied by another machine 
piece, then the computer no longer has MPOSMV(N)=957, 
because it cannot capture its own piece. However 
there will now be generated MPHMV(M)=957, indicating 
Viste erMe phece Om square 57 is captured, then 
piece number 9 can recapture. Phantom moves are 


also used to indicate double attacks, as when a 
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rook rests behind another rook. The rear rook has 
phantom moves "through" the rout rook to indicate 
that both can attack the same square. The same 
holds true for rooks and a queen, bishops and a 
queen, and pawns and a bishop or queen. Any number 
of pieces in line can be handled. All PHMV's (and 
POSMV's) are deleted if they place the friendly king 


in check (that is, if the piece is pinned). 


MATTSQ(8,8) and OATTSQ(8,8) contain, for each square, the 


MPAR(L) 


sum of value and sum of the number of pieces at- 
tacking that square, for machine and opponent re- 
spectively. Thus if a queen and pawn are both 
attacking the same square - say square 22 - then 
MATTSQ(2,2) would contain 10002 (100 x (90+10)+2). 
As in the case of MPHMV and OPHMV, MATTSQ and 
OATTSQ are filled to reflect the fact that a Bishop 
and a Queen, for example, on the same diagonal can 
both attack the same square. It is because of this 
feature that PLAYER can predict the results of ex- 
changes without a tree search. However, in order to 
make its prediction, PLAYER assumes that each side 
will capture with its least valuable piece, given a 
Chemee (hndcmacsumption May not be valid if, for 
example, the opponent sacrifices a high-value piece 
for positional advantage. 

and OPAR(L) contain the values of the evaluation 


parameters for machine and opponent respectively. 
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At present there are l2 parameters developed for the 
opponent and 18 for the Penne. These parameters 
will be discussed in greater detail below. 

NWI(L) contains the set of weights used by PLAYER in conjunc- 
Tion with MPAR and OPAR to make a decision. NWT is 
the array that is modified by PRO in the training 
phase of PLAYER. 

MCAS,OCAS ,MCA,OCA,MENP,OENP are six important flags which are 
used throughout the program to indicate the status 
of castling and en passant capture possibilities. 

2. MAIN 
fees om aet ariely Shor, program which reads MPC, OPC, 

The six flags and the opponents move, calls SITU with this 

mrormavion and based on the output from SITU, calls SITU 

again for each possible move of the machine. MAIN saves 

the best move returned from SITU as determined by MPAR and 

OPAR. It then prints the move chosen as well as the new 

Values for MPC, OPC and the six flags. 

So Siu 
Swede the cConurolling Subroutine for the other 

Pour Subroutines in the program. It calls the other sub- 

meubines im a preseribed order, but can be accessed as 

though it were the machine's or the opponent's turn to move. 
PlliUgmmgct calls EXEC to execute the move just made. 

The move made may be an actual move from the opponent or a 

possible move by the computer. Now SITU calls MOVES, CHECK 


and PARGEN to determine the set of parameters for the player 
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maose turn it 1s to move. The sets of parameters MPAR and 
OPAR are returned to MAIN. 
4, EXEC 

EXEC is the subroutine which executes a move. The 
move executed may be an actual move, phantom move or possi- 
ble move, depending on MAIN's call to SITU. In addition to 
normal moves, EXEC also handles castling, en passant capture 
and pawn promotion. It also changes the status of the six 
flags if a castling move is made or if a pawn moves so as 
to be in a position to be captured en passant. (Castle flag 
changes are also made if either rook moves from its original 
besttron, if the king moves or if any of the squares over 
which the king would pass while castling are such that the 
fee would be in check, or, of course, if the king is in 
check.) If a pawn is promoted, EXEC changes the value in 
MVALPC or OVALPC and OCCSQ of the piece concerned to that 
of a queen. If a piece is captured by the move executed, 
EXEC changes the pertinent values of MPC and MVALPC (or OPC 
enemovALPC)} and OCCSQ to zero. 

5. MOVES 

MOVES is the subroutine which develops all possible 
moves for each player based on a given situation. It is 
PsOmusScCOmmeme@nohn mol concurrently, to determine whether a 
player is in check. 

If MOVES is called with NCHK=0, it will return the 
set of all possible moves, all phantom moves, and attacking 
Squares for one player. The set of moves returned includes 


Special moves such as en passant capture and castling. 
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itewiOveses called with NCHK=1, it will return the 
value NCHK=0 if the player is not in check and the value 
NCHK=1 if the player is in check. NCHK is the only mean- 
ingful parameter returned when MOVES is called with NCHK=1. 

6. CHECK 

One of the basic concepts of chess is that of a 
pinned piece. A piece is pinned if its movement will result 
dn its own king being in check; any such move is illegal. 
mince MOVES will not detect a pinned piece, subroutine CHECK 
Meeewreitbten to accomplish this detection. 

CHECK receives as input the possible moves generated 
by MOVES, saves all necessary arrays and flags, calls EXEC 
to execute each possible move and then calls MOVES with 
NCHK=1 to determine if the possible move is legal. Illegal 
moves are eliminated from the list of possible moves. The 
meecess is repeated for each phantom move, and in all cases 
MATTSQ (or OATTSQ) is reduced accordingly (except in the 
case where the MATTSQ element is the location of the op- 
posing king, since a pinned piece can still check). 

The combination of MOVES and CHECK ensures that only 
legal moves and legitimate attacking squares are presented 
to PARGEN for evaluation. 

(ee EC ARGEN 

PARGEN receives as input from EXEC, MOVES and CHECK 
the arrays OCCSQ, MPC, OPC, MPOSMV, MPHMV and MATTSQ (or 
OPOSMV, OPHMV and OATTSQ) and uses them to generate a set 


of parameters which can be used to evaluate the current board 
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position. Note that the current board situation presented 
mon ARGEN can be either the original position or that arising 
from the execution of one of the machine's possible moves. 
Parameters 1 through 11 are generated for both 
players; parameters le through 1/ are generated for the ma- 
chine only; parameter 20 is the weighted sum of all the other 
Darameters. 
The following is a description of the parameters 


generated by PARGEN: 


PAR(1) Mobility: PAR(1) is the number of all possible legal 
moves from the current board position. If PAR(1)=0, then 

mide DOsiltion is checkmate. 

PAR(2) Material Value: PAR(2) is the sum of the values of 
all the pieces still on the board, exclusive of the king (the 
ralmeecannot be lost). 

PAR(3) Pawn advancement: PAR(3) is the sum of the squares 
of the ranks of each pawn. This parameter rewards pawn ad- 
vancement in the hope of eventual pawn promotion. 

PAR(4) Center Control: PAR(4) gives credit for each pawn 

in the center four squares. It also gives credit for at- 
tacking opposing center pawns or defending own center pawns. 
The importance of center control in chess has been known 

fem cenburies . 

PAR(5) Pressure: PAR(5) gives points for reducing the 
number of opponent moves to one. It also gives points if 

the opponent can make only king moves. 

mono meine Protection: PAR(6) gives points for own pieces 
directly in front of own king. This parameter was designed 
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to reward good castle-pawn structure. 

PAR(7) Castle: PAR(7) gives 100 points if any possible move 
aS 9a castie move. It gives 200 points if the player has 
castled. 

PAR(8) Early Development: PAR(8) gives points for moving 
own pieces (bishop, knight or queen) off the back rank. 
PAR(9) Attack I: PAR(9) gives points for a queen or rook 
attacking the opponent's back rank. It also gives points 
for a queen or bishop attacking the opponent king's castle 
Paw Structure. 

PAR(IO) Attack II: PAR(10) gives points for attacking any 
opponent pieces. 

PAR(11) Pawn Development: PAR(11) deducts points if a pawn 
is blocked by an opposing pawn. This parameter is designed 
to operate in conjunction with PAR(3). 

PAR(12) Exchange: PAR(12) determines the result of all 
possible exchanges. It deducts points severely if the ex- 
@mange will be lost; it gives points if the exchange would 
be won (but note that the opponent will probably make an- 
other move rather than participate in a losing exchange). 
PAR(13) Pawn Pressure: PAR(13) deducts points if an op- 
posing pawn can threaten a piece in one move without being 
captured. This is an attempt to eliminate fruitless moves. 
PAR(14) Danger I: PAR(14) deducts points if the opponent 
can move a queen or rook to an open file without being cap- 
mieed., iit deducts further points if opponent will have more 


pieces attacking the back rank than the machine has defenders. 
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Poems) Danger If: PAR(15) deducts points if the opponent 
Gan move a queen or bishop to an open diagonal or if he can 
Mere a queen or rook to a position such that, without being 
captured, he can attack the machine's castle-pawn structure. 
It deducts further points if the attackers of the machine's 
pawn structure outnumber the defenders. 
meet l6) Attack IIT: PAR(16) gives points for the machine 
being in position to move to an open file in the same manner 
as PAR(14). 
PAR(17) Attack IV: PAR(17) gives points for the machine 
being in position to move to an open diagonal or to attack 
the opponent's castle-pawn structure in the same manner as 
meer (15). 

After determining these parameters, PARGEN multi- 
plies the resultant parameter vector by the input weight 


vector NWI, and transfers the result via SITU to MAIN. 


Bo JeAgt®, 
PRO is a short program which carries out the adaptation 


algorithm of Widrow and Hoff [31]: 


PRO reads the value of the weights and parameters as 
provided by PLAYER, performs the adaptation algorithm, and 
peints the results. 

The @rivic funetion described in the section on adaptive 
logic is performed by the programmer. The programmer deter- 
mines the worth of a PLAYER decision by consulting standard 


texts, asking PLAYER to decide a move from a published position, 
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mmewcomparing PLAYER's move to that of the expert involved 
in the published position. Any arbitrary position can be 


presented to PLAYER for training or for testing. 


D. SUMMARY 

As has been shown, the basic working method of most 
Other chess programs is as follows: First successor nodes 
CO the problem situation are generated and ordered in a 
Dlausibility hierarchy according to a heuristic value func- 
tion. the N "best" nodes are expanded and searched as 
deeply as possible within real-time constraints, the search 
being guided by chess heuristics. The end nodes of the 
tree generated are evaluated, using the same or another set 
of heuristics, and the evaluation is "backed-up" to the 
problem node in order to decide which move to make. The 
purpose of searching through so many nodes is to attempt to 
make up for the fact that the original plausibility ordering 
is iiperiect. 

PLAYER and PRO are based on the postulate that there is 
a perfect value function in chess, that this value function 
Gepends on specific knowledge of every aspect of the given 
problem situation, and that this value function can be de- 
wermined with the aid of adaptive logic. 

Pie smieunoomOlerbAYmsm and PRO is to generate the first 
successor nodes to the problem situation only, to evaluate 
these nodes as completely and specifically as possible, and 
Pomerat tne value funetion generator — the decision-maker - 


to make the best decision using adaptive logic techniques. 
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V. CONCLUSIONS 


A. EVALUATION METHOD 

The method chosen to evaluate the capabilities of PLAYER 
in ordering moves is one in which quantitative results are 
produced. it is felt that these results are more meaning- 
ful than a subjective appraisal based on actual play. 

In order to test PLAYER, 40 chess positions were chosen 
from three chess texts. Most of the positions were taken 
from those appearing in actual games between grandmasters; 
Seters were positions used for instructional purposes. In 
‘each case it was assumed that the move made by the expert 
is in fact the best move. PLAYER assessed each position 
and printed all moves possible from that position, ordered 
according to its evaluation function. The rank assigned 
the recommended move by PLAYER was used as an indication of 
ememworcn Of PLAYER's evaluation function for that position. 
in other words, if PLAYER were perfect, then it would always 
rank the recommended move as number one - it would always 
make the recommended move. The closer PLAYER is to perfec- 
tion, the higher it will rank all recommended moves. 

All positions evaluated are illustrated in the diagrams 
in Appendix A. In these diagrams, abbreviations for the 
chess pieces are used as follows: K=King, Q=Queen, R=Rook, 
B=Bishop, N=Knight and P=Pawn. Pawns are named according 


eOwuhneir file (see Figtre 9); that is, the pawn in the 
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Queen's Rook (QR) file is called the Queen's Rook's Pawn, 
abbreviated QRP. A minus sign is used to indicate Black 
pieces; a plus sign is used for White. The moves are listed 
in standard chess notation, for example Q-QB3 means the 
Queen is moved to square QB3 (see Figure 9). Where no con- 
fusion can arise, the first letter of the piece designation 
or square designation may be omitted, as in Q-B3 vice Q-QB3 
or P-K4 vice KBP-KH¥. An 'x' indicates capture, for example 
Queen takes Knight would be abbreviated QxN. 

Where moves are listed ina line of text, as in Figure 
20, for example, they are always listed in the order White 
move, Black move. Moves followed by an exclamation point 
‘(!) are judged - by the expert - to be very good moves; 
moves followed by two exclamation points (!!) are judged 
unusually good TIES The computer is playing White in all 
moves except moves number 21 to 23. Recommended moves are 
all underlined in the diagrams of Appendix A. 

It should be emphasized that this test is a very de- 
manding one. The forty situations include samples from the 
opening, middle and end games. There are piece sacrifices, 
developmental moves and positional moves included. Almost 
half the recommended moves in these selected situations were 
judged very good or unusually good by the standards of chess 


SXDeErts. 


iy delapOleh Ss 
The results of the test of PLAYER are shown in Table I. 


The columns of this table show the number of the position 
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PAE. 1 . 


Position 
Number Comments Total Moves Ranking 
ti, ee) Gs) Do 48 
ae a8 t 
3. 45 9 
4, AT eb) 
Des 48 3 
6. (S) (2) D3 ae 
7. (1) 45 ZA 
oe Co 48 4 
9. 45 6 
Oe 38 He 
Be; 37 10 
ae Wy 29 
iS. 41 7 
14. Gy) 36 1 
By (1) 42 1 
HG. Cy) 46 a2 
i Grits) 50 Belk 
leew 40 Z 
LSS 20 a 
210) 5 29 3 
Das: 20 : 
Ber 20 1 
ae aT 1 
24. ie) 37 2 
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Semsidered, comments concerning the recommended move, the 
total number of moves evaluated by PLAYER for each position 
and PLAYER's ranking of the recommended move for each 
mosition. 

The average number of moves per position generated by 
PLAYER for evaluation was 39. Of the 40 positions considered, 
PLAYER ranked the recommended move in the top ten moves 31 
times. The recommended move was ranked in the top five 
moves 24 times, and 14 times PLAYER chose the recommended 
move exactly. 

Piece sacrifice moves —- designated by (S) in Table I - 
were all ranked very low; this is to be expected as PLAYER 
was programmed to avoid sacrifice if at all possible. 

With two exceptions, all the moves ranked lower than 
ten were either sacrifice moves of ‘very good' moves - or 
both. These are precisely the kinds of moves which require 
the most profound understanding of the subtleties of chess; 
that is, these are the moves which separate the master from 
the amateur. 

PLAYER ranked one ‘unusually good' move in the top five, 
ranked 9 'very good' moves in the top ten (7 of these in the 
top five) and found 4 ‘very good' moves exactly. 

Judged in the context of other existing chess programs, 
PLAYER's performance is impressive. The results are suffi- 
ciently encouraging to warrant further investigation into 
what is demonstrably a viable technique. 

Improvement in PLAYER's performance can be obtained by 


the generation and refinement of more parameters and by more 
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training in conjunction with PRO. In particular, a means 
should be found to determine when a piece sacrifice will 
mesulvb in a winning position or combination. In order to 
make a decision of this kind, the computer would have to 
be programmed to develop and examine a small set of plans. 
That is, the computer would select a few key pieces, and 
for each selected piece examine a few sacrifice moves to 
determine whether the projected sacrifice would result in 
positional gain. (The set of all possible sacrifices could 
not be examined because of time constraints.) If a means 
could be found to have the computer select the ‘best set' 
Of pieces and moves for possible sacrifice, the resulting 
program would for the first time approach the level of 


Sephnastication of the human mind. 
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Po eeNOE eA EVALUATION POSITIONS 


EOoTEeon. | 


at fat | fe fal 
fe{-f-of | fe [ele 





Recommended Move [32] 


1. R-K8!! 


Figure 10. 


DS 





EOcmeoens 2 — 6 










ue 


eae ef} 
Bioiel-| |-|_ 


Recommended Moves [33] 





2. N-Q5 Q-Q3, 
then 3. B-KN5 IE 
then 4. Q-B2 B-Ql, 
Vien . ee 5 P-Q3, 


then 6. B-QN5! 


Bee ee i. 
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Positions 7 = 10 






ee] fi) le 
ee || | 
eee | || | 
SSS e200 
ERR 
SOROS 


Recommended Moves [34] 















jes Vise ein R-B2, 
then 8. Q-B3! B=Oe.. 
then 9. NxB NxN, 


idiot Ome hCr 


Pemeure ie. 


oe, 





FosyeLrons tl — 12 


et tele | [et TC 
pt tt tt fel 
fe} | ttt fe 
et iti | 





Recommended Moves [35]: 
ii, Oar RxQP, 


Pnem L220) RXR. 


Hagwies. 13. 
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POsita2on 13 





Recommended Move [36] 


13. R-K4. 


Figure 14. 


DA; 





Ecsttrons lt = 16 





Recommended Moves [37] 


14,  KR-B1! B-R3, 
then 15. R-B7! sag 


then 16. Q-R3! 


Hawuee 15 . 
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Rosrtcrons If — 18 





Recommended Moves [38] 


ij N=O7 2: NxN, 


then 18. RxN. 


Figure 16. 
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m@Ositions 19 — 20 





Recommended Moves [39] 


19. P-K4 P-K4, 


then 20. N-KB3. 


Figure 17. 
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RoOsdes One. c | 


+N 





Recommended Move [40] 


2 P-K4, 


Figure 18. 
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Positions 22 ~ 23 









ee fe fe] fel ef ele 


Recommended Moves [41] 


Cee eteun P-Q4H, 
then 23. P-QB4 P-K3. 
Figure 19. 
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Eeswuons 21s) 26 





Recommended Moves [42] 


24, Q-B3! P-B3, 
then 25. N-Q2! N~B5, 


then 26. K-Bl 


Figure 20. 
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HOsrteons 2/ =] 29 





Recommended Moves [43] 


27. R/R3-KB3! NxN, 


then 28. RxN! RxR, 





then 29. KPxR! 


Pau Pe 2 1), 
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Postion 30 





Recommended Move [44] 


30. N-N5ch! 


Figure 22. 
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BOs Orn: 31. 









Recommended Move [45] 


Bde Gi 


Pigure 23. 
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Positions 32 - 34 


Cee 


Recommended Moves [46] 





32. Q-K5! R-R1, 
then 33. R-B/7/'! Q-K3, 


then 34. QxQ 


Figure 24, 
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Posuurons 35 — 3/ 





Recommended Moves [47] 


35. N-QB6 Pel. 
then 36. R-QN1 K-R1, 


then 37. Q-Bl mate. 


Figure 25. 
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POsituons) 36 — 46 





Recommended Moves [48] 


R-B8 RXR, 


38. 
then 39. 


QxR, 


R-B8 


Q-Q8 mate. 


Ginen +10). 


Figure 26. 
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